Skip to content
This repository was archived by the owner on Jul 22, 2025. It is now read-only.

Conversation

@nvh0412
Copy link
Contributor

@nvh0412 nvh0412 commented Oct 14, 2024

I’m on the fence about this implementation, actually. Given that we’re about to implement a quota system to limit AI tokens, it makes sense to me to allow the Admin to prevent the AI bot from automatically updating the title of the inbox topic, as it does consume a significant number of tokens.

In this PR, we add a new setting with the default set to true to maintain backward compatibility with the current behavior. We can utilize this setting to prevent our Playground from automatically generating the title right after it finishes the reply_to method.

@nvh0412 nvh0412 force-pushed the feat/add-new-setting-to-disable-automatic-topic-title branch from 27356e3 to 6fc9c2d Compare October 14, 2024 12:31
@nvh0412 nvh0412 marked this pull request as ready for review October 14, 2024 12:33
…re of the AI bot

Add a new setting with the default set to true to maintain backward compatibility with the current behavior.
We can utilize this setting to prevent our Playground from automatically generating the title right after it finishes the reply_to method.
@nvh0412 nvh0412 force-pushed the feat/add-new-setting-to-disable-automatic-topic-title branch from 6fc9c2d to 1ae2eac Compare October 14, 2024 20:28
@SamSaffron
Copy link
Member

I worry about having too many knobs sometimes.

Maybe as a middle-ground here we just make this a hidden setting, so you can disable if you really need it.

I have not seen this come up yet on meta.discourse.org , in the big scheme the title generator uses many orders of magnitude less tokens.

@nvh0412
Copy link
Contributor Author

nvh0412 commented Oct 22, 2024

Yeah, that's why I'm still here, on the fence. I think I can close this PR for now and revisit it when it’s actually needed.

@nvh0412 nvh0412 closed this Oct 22, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants